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Human Brain is wired for Spatial Computation 



for directions " 

Translations 



A childhood IQ test question 


Rotations 
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Agenda 

• Rotations and Matrices (hopefully review) 

• Combining Rotations 

• Matrix and Axis Angle 

• Challenges of deep Space (of Rotations) 

• Quaternions 

• Applications 
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Terminology Clarification 

Preferred usages of various terms: 


Linear Angular 


Object Pose Position (point) Orientation 

A change in Pose Translation (vector) Rotation 
Rate of change Linear Velocity Spin 


also: Direction specifies 2 DOF, Orientation specifies all 3 angular DOF. 
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Rotations Trickier than Translations 


Translations 



a then b = = b then a 


Rotations 



x then y != y then x 


(non-commutative) 

• Programming with rotations also more challenging! 
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2D Rotation 0 


Rotate •[! 0] by 0 about origin 



CD 


to 


1,1 



[ cos(0) sin(0) ] 


cos 0 1,0 
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2D Rotation 0 
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Rotate o [0 1] by 0 about origin 


O [-sin(0) cos(0)] 
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2D Rotation 



At 90° 
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of an arbitrary point 

Rotate o about origin by 0 


O = cos 0 


/ 


+ sin 0 


N 
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2D Rotation of an arbitrary point 













f 







o 











; 









y 














X 













Rotateo x 


about origin by 0 



x! = x cos 0 — sin 0 
= x sin 0 + cos 0 
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2D Rotation Matrix 



Rotateo x 


about origin by 0 



x! = x cos 0 — sin 0 
= x sin 0 + cos 0 



X 

i 

vy'\ 

- 


cos 0 


— sin 01 r*i 

cos 0 J \y\ 


— sin 0' 
cos 0 - 


is rotation by 0 
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2D Orientation 



X 


Yellow grid placed over 
first grid but at angle of 0 


x \ 

cos 0 — sin 01 

sin0 cos0 1 


Columns of the matrix are 
the directions of the axes. 


Matrix is yellow grid's Orientation 
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2D Passive Transformation 



Basis: 


cos 0 
sin 0 


— sin 01 

COS0 1 



cos 0 
sin 0 


— sin 0 


x- 

COS0 - 


y. 


(note: exact same math as before) 


v 


both same point but 
In different reference frames 


LyJ 
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3D Rotation around Z axis 


Z axis 



— sin 0 01 x ' 

cos 0 0 y 

0 lJ U. 
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Can Rotate around X and Y too 





X 

1 

- 

y 

— 

_z'_ 

- 


cos 0 0 sin 0 

0 10 
— sin 0 0 cos 0. 



X - 


y 


. 


O 
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Rotating Objects (changing orientation) 


Rotations: 


0 0 1 

0 10 

-1 0 0 


10 0 

0 0-1 
0 1 0 J 


0 -1 0 

10 0 
0 0 1 



i 


90° on Y ^ 

unutf 


90 on X 


90 on Z 


□□□ 


o 






Orientations: 



ri 

0 

01 


0 

1 

0 


10 

0 

lJ 


0 0 1 

0 10 

-1 0 0 


0 0 1 
10 0 
0 1 0 



T-H 

1 

1 

0 

O' 


0 

0 

1 


. 0 

1 

0. 


Matrices used for both rotations and orientations 


Quat rotations: 
orientations: 


[0 .7 0 .7] 


[.7 0 0 .7] 


[0 0 .7 .7] 


[0 0 0 1 ] 


[0 0 .7 .7] 


[.5 .5 .5 .5] 


[0 .7 .7 0] 
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Row vs Column Conventions 


OpenGL and most math books use column vectors: 

v' = Mv = BAv 


Some engines, APIs (DirectX) use row convention: 

v' = v M T = v A T B T 



All the same. 
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Combining Rotations 
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Combine a sequence of Rotations 

Rotate v by A, then B, then C... 

= C ( B ( Av )) 

Mathematically we know 

C(B(Av)) == (CBA)v 
So with matrix-matrix multiplication let: 

R = C B A 

R is a single rotation that is the same as rotating 
by A, then by B then C. 
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Multiplication Order: 


W 

O 

R 

L 

D 


90 on 
World Y 


90 on 

"World" X 


B 


world 



i 


^world 

I ^ “i 

t m \X m 

□ □□ 



0 


0 

0 


L 

o 

c 

A 

L 


^local 

90° on 
Local Y 
(dice side 2) 


B local 

90° on 

"Local" Z 

(dice side 3) 
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top of page 

Y 

riaht side 

o 0, %. 

of page 

World Coordinate Frame 


Y 

f 

\ I— X 

z* ' 

Dice Coordinate Frame 
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Multiplication Order: 


W 

O 

R 

L 

D 


90 on 
World Y 


90 on 

"World" X 


B 


world 



i 


^world 

I ^ “i 

t m \X m 

□ □□ 



0 


0 

0 


L 

o 

c 

A 

L 


^local 

90° on 
Local Y 
(dice side 2) 


B local 

90° on 

"Local" Z 

(dice side 3) 
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Math Equations 






dice 


new 


B world * ^ world * dice 



dice new dice * A local * ^ local 


Both produce'. 120° on [1 1 1] 
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Example When to use Local frame 


• Player "pulls up" on 
flight stick. 

• Pitch upward about 
object wing (x) axis. 

• World x irrelevant 

• Multiply rotation (about 
x) on the right hand 
side 

Sidenote: a point doesn't 
have an orientation, so never 
do this for points. 






Math: 



10 0 
0 cosO — sinO 
0 sin 0 cos 0 



climbing _ cruiseing pitch_up 
orientation orientation rotation 
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Find Rotation R Between Orientations A and B 

need to be more specific 

• Have an object with orientation A, what rotation R will change it 
to have orientation B? 

R = BA' 1 


• Given a direction v in reference frame A, what rotation R will 
show how v points according to B? 

R = B _1 A 


Be aware of all the details of the problem to be solved. 
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Rotating (Reorienting) a Rotation 


Machine that 
rotates an 
object by rc : 


Apply 45° 
Tilt to the 
Machine: 


rot 
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Rotating a Rotation - Its Different 


4 






"\ 


Neither of these 
multiplication 
sequences work 



J 
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Rotating a Rotation: Decompose Steps 


Tilted 

Machine: 



4 


How to calculate 
what this new 
rotation will be? 


Rotate duck into and back out of the machine's reference frame: 







Same 
Result! ~ J 
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Rotating a 



Rotation: The Mathematics 

Initial 

equation 

new duck' duck 

= rot * 

orientation orientation 





new duck" = 
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Rotating a Rotation 

Now drop the duck... 



rot £Hted 


tilt 
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The Mathematics 



* rot * tilt 1 
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Matrix & Axis Angle 
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3D Orientation / Rotation Matrix R 


z 


Rx x 

Ry x 

Rz x 

A 

R = 

RXy 

Ry y 

RZy 



X 

N 

Ry z 

Rz z 



X 


General form of Rotation Matrix: 

• Orthonormal basis: Rx R R 

• Rz = Rx x Ry etc. 

• Determinant(R)= = l 

• Inverse(R) == Transpose(R) 

• Has a corresponding axis of rotation 
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Rotation Matrix - Finding its Axis Angle 




axis, 6 


axis will be an eigenvector of R 
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Example of corresponding Matrix and Axis Angle 




axis,Q = [11 1], 120° 


To check, verify: axis —— R * axis 
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Matrix from general axis a, angle 0 


a axis 



Matrix for a,Q ? 
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Matrix from general axis a, angle 0 



How would axis/angle rotate a point \x,y,z ]? 
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Matrix from general axis a, angle 0 


Find b,c unit vecs a,b,c orthonormal 

a = b x c , c = ax b, b = c x a 
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Matrix from general axis a, angle 0 


Find b,c unit vecs a,b,c orthonormal 
a = b x c , c = ax b, b = c x a 

Get [xyz] as weighted sum of a,b,c 
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Matrix from general axis a, angle 0 





Find b,c unit vecs a,b,c orthonormal 
a = b x c , c = ax b, b = c x a 


Get [xyz] as weighted sum of a,b,c 
Stuff along a stays the same, 

Results along b & c based on sin0 and 
cos0 portions along b & c 


X 



X 





y 


= a \ a 


y 


+ 


b lb 


y 


cos 0 — c 


y 


sin 0 j + c ( b 


y 


sin 0 + c 


y 


cos 0 


z 


z 


z 
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Matrix from general axis a, angle 0 


Find b,c unit vecs a,b,c orthonormal 

a = b x c , c = ax b, b = c x a 

Get [xyz] as weighted sum of a,b,c 
Stuff along a stays the same, 

Results along b & c based on sin0 and 
cos0 portions along b & c 



O 


O 


X 

z' 

V 

y r 

z' 


= a a 


x 

y 

z 


+ b\b 


x' 

y 

z 


cos 0 — c 


X' 

y 

z 


sin 0 + c lb 


= (aa T + bb T cos 0 — bc T sin 0 + cb T sin 0 + cc T cos 0) 


x' 

y 

z 



sin 0 + c 


y 


cos 0 


Lzj / 

"still need method 
for finding b,c" 
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Matrix from general axis a, angle 0 


Alternatively (Equivalently): 

Think of [ b,c,a ] as a 3x3 basis. 


• Move/rotate into abc's 
reference frame. 

• Do spin on 'local' z axis 

• Rotate back out 



o 

x! 

- 

y 1 

= [b c a] 


z ' 

- 


cos 0 - sin 0 0 

sin 0 cos 0 0 

0 0 1 


b 

c 

a. 


' x ' 

y 

z 


a axis 



3x3 Rotation Matrix 


CL X 

CL-. 


a. 


cos 0 
sin 0 
L 0 


— sin 0 0 

cos 0 0 

0 1J 


au 


a. 


'X' 

y 


a. 


"ok, but this math is stiff not concise. 
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Challenges with the Space of Rotations 
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Matrix Disadvantages 

Great for some systems (batch rendering), but not 
ideal for animation, gameplay, or physics code. 

• Non-compact (9 floats for only 3D0F) 

• Numerical Drift, non-orthonormal over time 

• Getting meaningful information non-trivial? 

• Extracting an axis of rotation by eigenvector 

• Interpolation between orientations (keyframes) 



Rx x 

Ry x 

R X 

RXy 

Ry y 

R y 

Rx z 

Ry z 

Rz z 


Is there a better way to be working with rotations/orientations? 
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Yaw-Pitch-Roll (Euler angles) 


• Ordered sequence of rotations on 3 fixed main axes. 

• Ideal representation for many game systems: 

• Standing NPC (yaw==heading) 

• Camera AI, 

• Helicopter flight. 

• Convert to Matrix on the fly as necessary. 




y,p,r = 0,0,0 


45,0,0 


45,0,45 
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Yaw-Pitch-Roll - not ideal for general 3D 


• Concatenating rotations: Done by matrix 
multiplication. Converting back to YPR? © 

• Smooth interpolation and comparing rotations. 
What's the angle between: 



[20 80 -20] [-60 80 60] 



Numerically distant, but 
Orientations similar! 


Consider pitch 
upward to 90: 


I 



Could be: 

[0 90 0] or 
[45 90 -45] or 
[n 90 -n] (any n) 
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Angle Axis 

Axis Angle has Potential: 

• General 3D 

• Compact (drift averse) 

• Inversion and Interpolation easy (just modify angle) 

Issues: 

• Specifics of the encoding (angle as separate number or axis length?). 

• Transforming points shouldn't be clumbsy. 

• Need a better/cleaner conversion to matrix. 

• How can we "multiply" (combine) two Axis Angle rotations??? ... 
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Combining Angle Axis Rotations xt ' s Tricky ... 


Small Angles: 




Head easier 

to visualize. 


at a small angle. ©-■ 


[1 0 0L10 o then [0 1 0],10° ~= [1 1 0],14 ° 


Tilt, Turn, No Roll. 

" Result axis/ angle 
is almost like 
vector addition on 
the xy plane " 



[100], 180° then [010], 180° [0 0 1],180° 


" Hmmm , 
Combining 
X and Y 
somehow 
make Z" 
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Combining Angle Axis Rotations 


It's Tricky 

Because... 



Order of rotations makes a difference... 




GAME DEVELOPERS CONFERENCE' 2014 MARCH 17-21, 2014 GDCONF.COM 


Combining Angle Axis Rotations Tricky 

Because 

Rotations 



Yikes. Is there any mathematics wizardry that can deal with this? 
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Quaternions - Mathematics of Rotations 
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Quaternions - Mathematics of Rotations 

• Practical and Efficient (get the job done). Provides the 
machinery your program uses for rotational operations. 



• Industry-wide standard algebraic system for dealing with 
rotations in 3D. (existing code, popular engines). You'll 
need this. 


• Geometric Algebra encompass (and surpass) quaternions. 

• Still worth studying quats (stepping stone) 

• A bit abstract (4D and complex numbers). Best to think 
visually/spatially. 
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Quaternions - not too complex © 

• Like complex numbers a+bi , but with 3 l sqrts of -1; i,j,k 

• ii=jj=kk=ijk=-l , so ij=k , ji=-k , jk—i, ki—j 

• Numbers of the form: q= a+bi+cj+dk (math text notation) 

• Isomorphic to Clifford Algebra R 3+ : q- a+be 23 +ce 31 +de 12 

• In Practice: q= xi+yj+zk+w (graphics/gamedev convention) 

• Quaternion multiplication: 

^~\~Q, X byy “1“ CLyb Z CL Z by CLyy b j ^ i 
+ ( CL x b z “I - CLyb w CL z b x ~\~CL W bj)j 
y~\~ CL X by CLyb X + CL Z byy CLyy bfcjlt 
H - ^ a x b x CLyby CL Z b Z ~\~CLyy byy ^ 

Connection to Rotations may not be obvious yet... 
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Quaternions as Bivector, Scalar [v,w] 


Equivalent to write quaternion as a bivector, scalar pair: 

• Group the xyz elements into a 3D bivector v alongside w. 
Instead of. [ 9 %* 9)^ 9iv]/ its now. 




Quaternion multiplication equivalent to: 

(lb \&y > CL W \ * \by, ^vi/] \dy ^ by H” dybyy “I - dyyby 

V Y ' 

Cross Product 


, CLy ' by + CLyyDyy 


Dot Product 


some familiar operations 
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Unit Quaternions and Rotations 

Use Quaternions on unit 4D hypersphere (x 2 +y 2 +z 2 +w 2 == 1): 

• rotation/orientation with axis a and angle 0: 



• Length of bivector part proportional to sin of half of angle. 

• Value of scalar part w keeps quaternion at unit length (or cos of same half angle). 


May be easier to visualize just using the (3D) bivector v component. 
But its not a regular (Euclidean) 3-space. 
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Unit Quaternions and Rotations 

Double Coverage: 

Rotation around axis a and angle 0 would produce the same result 
as rotation around axis -a and angle -0. 

Therefore, q and -q represent the same rotation. 


Inverse: 


Rotation around axis -a and angle 0 (or around a by - 0) would give 
the opposite rotation. Since q is of unit length just use conjugate: 


q 1 = conj(q) = [-x,-y,-z,w] = [-v,w\ = 


-a sin 



cos 
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Examples Revisited with Quaternions: 


Small Angles: 

approx 10° on X 
then 10° on Y 



[0 0.1 0 0.99] * [0.1 0 0 0.99] ~ = 



approx 15° 
on [1 1 -.1] 


[0.1 0.1 -0.01 0.99] 



[ cl v x b v + a v b w + a w b v , —cl v ■ b v + a w b w ] — [[0 10]x[10 0] + 0 + 0,0 + 0]— [0 0—10] 

v V ' 

Only Cross Product Matters here 
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Examples Revisited now with Quaternions: 


90 on X 90 on Y 

7 



□ 

□ 

□ 

□ 

□ 

□ 


0 


120 on [1 1 -1] 

/-r O 


0 



c 


□ 

□ 

□ 

□ 

□ 

□ 


0 


[0 .7 0 . 7 ] * [.7 0 0 . 7 ] = [ 0.5 0.5 - 0.5 0 . 5 ] 



90 on Y 90 on X 

o 4 - dd 


120 on [1 1 1] 





[0 .7 0 .7] [.7 0 0 .7] 


[0.7 0 0 .7] * [0 .7 0 .7] = [.5 .5 .5 .5] 


Numerical values added just to see that the quaternion math indeed matches expectations. 
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Rotating Points/Vectors with Quaternions 


Representation 

Combine 
Rotations a,b 

Rotate points or 
vectors (v) 

Matrix: 

M b M a 

M v 


Quaternion: q b q a 


q V q 1 


• Matrix multiplication applies to both rotating points/vectors and 
other matrices. 

• Rotate a point or vector v by treating it as a quaternion [>,0] and 
multiply by rotation and conjugate on the left and right sides 
respectively. Or use quaternion-to-matrix conversion. 
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qvq 


, m ultiP ly 

Kise t1 ree 

%> erS 


e 


-1 


qvq 1 = 


e 9 

a sin — , cos — 


6 


[v, 0] 


9 9 

—a sin — ; cos — 


ab = [a v x b v + a v b w + a w b v , -a v ■ b v + a w b w ] 
quaternion multiplication (bivector-scalar style) 


6 


6 


sin — a x v + cos — v, — sin — a ■ v 


6 6 

—a sin — , cos — 
2 2 






e e 




■0 






e e e e e e e e e e e e & 

sin — a x v x —a sin— + cos— v x — a sin— + cos— sin — a x v + cos — cos— v H — a sin— sin — (—a • v), —a • v sin — cos— + sin — a x v ■ a sin— + cos— v • a sin — 

2 22 222 22 2 2 v 2 2 2 2 2 2 2 


Yikes 


9 9 9 9 9 9 

— sirr - axvxa + 2 cos — sin — a x v + cos z — v + sin z — (a ■ v)a, 0 

2 22 2 2 y J 


0 


? ^ < * > 9 9 9 

— sin —a xvxa + sin0axp + cos — v + sin — (a ■ v)a, 


cancel out 


*sorn e 

uS ®, f 



9 9 — q y q 

cos 2 — (a x 17 x a) — sin 2 -axi?xa + sin 0 a x v + cos 2 — (a ■ i7)a + sin 2 - (a ■ i7)a, 0 

2 i 2 4 2 4 2 

V ^cos 2 + sin 2 - 1 

= [cos 0 (a x v x a) + sin 6 (a x v) + (a ■ v)a , 0] after simplifying 
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Rotating Points/Vectors ,= 


e 6 

sin — , cos — 
2 2 


-1 _ 


qvq A = 


_ . , . . , . Portion along a 

Three OrlhogonalVe^ors^^^^ ^ same 

[cos 6 (a x v x a) + sin 6 (a x v) + (a ■ v)a , 0] 


Quaternion 

multiplication 

qvq 1 transforms 
v by rotation q 


sum weighted 
by sin and cos 


v lies in plane of 2 
of these basis vectors: 
v — (a x v x a) + (a ■ v)a 

t 
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Quaternions can replace most Rotation Matrices 

• Cameras or any general objects with position and orientation. 

• Rigid Bodies - physics engines mostly use vec/quat pairs 

• Vertex buffers instead of tangent, bitangent, normal can use: 

struct Vertex { 

float3 position; // location in mesh reference frame 
float4 orientation; // quaternion tangent space basis 
float2 texcoord; // uv's 
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Orientation Map 

• Extention of 
normalmap 

• rgba encodes 
orientation. 

Tangents T Normals N 


Q 





Orientations 



T angent 
Map 


Height 


Map 


1 


Slope 

\ 

Calculation 

i 


Normal 

Map 


V7 

Orientation 

Map 


Disc with specular (T • L) and diffuse (iV • L) 


Disclaimer: just 
curiosity research , 
not sure how useful. 
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SLERP - Spherical Linear Interpolation 

• Smooth transition between orientations q 0 ,q 1 

• Double Coverage Issue: Use -q 1 instead of q 1 if closer to q 0 

• Normalized Lerp (nlerp) often sufficient 

q t = normalize (q 0 (l — t) + <7i (t)) 

• Used by animation systems (blend keyframes) 


Resulting Skinned Animation 



Key 0 Key 1 



NLERP 0.5 
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Quats - they do Addition too... 

Updating state to the next time step. 

• Position : p t +at = Vt + Velocity * dt 

• Orientation (spin a > ): 


Proof it's the same: 


lim 5 

(IMI dt )-* o 


CD 

— dt, 1 


s * q t — [ 0001 ] * q t + 
\ 0 ) 

s*qt = Vt+ 2’° 


Cl) 

— dt ,0 


q t dt 


qt 


Could Build a Quat for Multiplication 


5 = 


^ . JMI dt JMIdt 

sin ( — ~ — )> cos ( — ~ — ) 


IMI 


Rt+dt = s*q t 



Or Add Derivative 

dq 

qt+dt = Rt + -fa dt 

0 ) 

Rt+dt — Rt ~2 Rt dt 

* 


Ok but why?... 
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Quat Application: Time Integration (no drift) 

. . . . . , - more quat 

Spin o) t is not constant!! 


nun^f' 

drift 



co(q t ) 

Rt+dt = Rt + — 2 — * Rt * dt 

Forward Euler 7 a 

only looks at starting spin 



Qt+dt = qt + k i * — + /c 2 * y + * y + k 4 * y 

Runge Kutta 

Takes samples over the timestep 
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Orientation Updates (Euler vs RK4) 



Forward Euler: 

• Spin drifts 
toward 
principle axis 

• Energy gained 

Runge Kutta 

• Spin orbits as 
expected 

• Energy stays 
constant 


Watch GDC 2013 Math Tutorial for full explanation of inertia tensor, time integration, angular momentum, rk4, ... 
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Rotation that takes one direction v 0 to another 


Cross product to find axis a 



<7 = 


a 


Hall 


What if 
I all was 0 

acos(d) 

sin i z I , cos 


Less stable 
when d ~ 1 

i/ „ 

acos(d) 



using 

half 

n — 

a | 

^V 2 (i + \ 


angle 

formulas 

H 

_V 2(1 + d ) 

\ 2 J 

T 


When i7 o and v t get close, 
a = v 0 xv 1 becomes small 
d = v 0 ■ i7 1 goes to 1. 

Ignore v 0 = -v 1 case for now 


GA style - 

geometric 

product 

produces 

rotation 

versor 


Let. v m ifi — 


\\VQ+Vl\\ 


R ~ \Vo * ^ mid> ^0 " Vmid\ 
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Diagonalization of Symmetric Matrices 

For symmetric matrix S find D,R\ 

D = RSR - 1 


a f e 
f b d 
-e d c- 


• Iterative approach [Jacobi 1800s]. 

• Algorithm can accumulate directly into 
Matrix or a Quaternion (3D). 

Eigenvalues are entries of diagonal part. 

If not all equal, this may be interpreted as an 
orientation for the matrix in some contexts. 

"Orientations may show up 
in new interesting places' ' 


Rotate Off 
Largest 



[xyz w], 



0 

0 

d J 
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Orientation of a Point Cloud 






Compute covariance 
Diagonalize to get orientation. 

Permute by eigenvalues for 
long, med, short axes. 


CO V = 




v z v x 


Vy 2 

V z Vy 


V X V Z 

VyV z 




use keys w^a^llorotate and move in/oXit — 

view rotated 1 5, aboBt^LCLei, user at I0,0,-0.1] 





UI: Data from 
Depth Sensor 


AI: Optimal 
bombing run. 



Principle Axes 
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Visualize Inertia Properties 

To debug physics behavior of rigid body: 

• Diagonalize Inertia Tensor (symmetric matrix) 

• Draw box over object with resulting orientation 

• Eigenvalues are box dimensions 



Irregular Shape Inertia Overlay 
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Dual Quaternions 

• Add a Vo or s, s 2 =0 

• q = [xi, yj ,zk, w ,x'i£, y'jz, z'ks, w'e\ 

• Put half translation t in dual part 

t" = [0,0,0, 1, tx/2, ty/2, tz/2,0] 

• Extend rotation rto dual quat 

r" = [r, 0,0, 0,0] 

• Multiply trans and rot dual quaternions 

q" = t"r " 

Rotation and Trans in a single 8D number q" 


To be continued (in Gino's IK session) ... 


Dual Quat Screw Motion 




S 

L 

E 

R 

P 


S 

K 

I 

N 

N 

I 

N 

G 


Matrix Dual Quat 
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Working with Rotations - Conclusion 

• Rotations can be tricky ( don't blame math ) 

• Matrices work 

• Quaternions work, more concise, more uses 

• Be Aware, Be Precise: 

• who to multiply 

• what order to use 

• when to invert 

Now go and do cool 3D stuff © 
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Q & A 


Raise your hand 
if you have any 
questions now! 
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